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(54) Filtering device and method for reducing noise in electrical signals, in particular acoustic 
signals and images 



(57) The filtering device (80) comprises a neuro- 
fuzzy filter (1 ; 80) and implements a moving-average fil- 
tering technique in which the weights for final recon- 
struction of the signal (oL3 (/)) are calculated in a neuro- 
fuzzy network (3) according to specific fuzzy rules. The 
fuzzy rules operate on three signal features (X1(/), X2 
(/), X3(/)) for each input sample (©(/)). The signal fea- 
tures are correlated to the position of the sample in the 
considered sample window, to the difference between a 
sample and the sample at the center of the window, and 



to the difference between a sample and the average of 
the samples in the window. The filter device for the anal- 
ysis of a voice signal comprises a bank of neuro-fuzzy 
filters (86, 87). The signal is split into a number of sub- 
bands, according to wavelet theory, using a bank of 
analysis filters including a pair of FIR QMFs (H 0 , and 
a pair of downsamplers (85, 86); each sub-band signal 
is filtered by a neuro-fuzzy filter (86, 87), and then the 
various sub-bands are reconstructed by a bank of syn- 
thesis filters including a pair of upsamplers (88, 89), a 
pair of FIR QMFs (G 0 , G t ), and an adder node (92). 
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Description 

[0001 ] The present invention refers to a tittering device and method for reducing noise in electrical signals, in particular 
acoustic (voice) signals and images. 
5 [0002] As is known, filters operating according to various linear and nonlinear techniques are used to remove unde- 
sired components from electrical signals. In particular, undesired components may be any type of noise (white noise, 
flicker, etc.) or other types of superimposed acoustic or visual signals. 

[0003] Linear filters are at present the most widely used instruments for filtering noise. Finite-impulse filters (FIRs) 
eliminate all the harmonics of a signal having a frequency higher than the cutoff frequency of the filter and improve the 
10 signal-to-noise ratio (SNR). Another linear filtering technique is based on the fast Fourier transform (FFT), where the 
signal is transformed into the frequency domain, the undesired harmonics are removed, and then the inverse Fourier 
transform is calculated. 

[0004] As far as nonlinear techniques are concerned, average filters are simple to design and may be implemented 
through simple hardware circuits. Average filters are based on the comparison of the individual signal samples in an 
15 time interval with the average of all the samples in the same time interval. On the basis of this comparison, the individual 
samples are selectively attenuated. 

[0005] All these methods share the disadvantage that, when removing the noise, also some of the components of 
the original signal are removed. 

[0006] Furthermore, none of the current techniques, whether linear or nonlinear ones, including average filtering, is 
2Q able to preserve steep edges of the signal. If a moving-average filter is used, the width of the window must be very 
small if steep edges are to be preserved. However, if the size of the window becomes small, there is no significant 
reduction in noise energy. If linear filters are used, all the frequencies above the cutoff frequency are eliminated, with 
consequent marked distortion of the signal. 

[0007] The aim of the invention is thus to provide a filtering method and device that does not cause a sensible 
25 deterioration of the signal and at the same time preserves the edges of the signal. 

[0008] According to the present invention a device and method are provided for filtering electrical signals, as respec- 
tively defined in Claim 1 and Claim 24. 

[0009] The filter and the method described are particularly useful in the case of signals having steep edges, for which 
the aim is to preserve the edges of the signals. Furthermore, it is possible to filter signals affected by white and non- 
30 white noise, such as flicker noise. Through the present method it is moreover possible to eliminate from a signal other 
signals that are superimposed on it and are characterized by a wide spectral range. 

[0010] The device and the method described are based upon a neuro-fuzzy network. They are implemented with a 
moving-average filtering technique in which the weighting factors (or weights) for the final reconstruction of the signal 
are calculated in a neuro-fuzzy network according to specific fuzzy rules. This enables a better reduction of the noise. 
35 The fuzzy rules operate on different variables, referred to as signal features. Described hereinafter are three signal 
features and six fuzzy rules. 

[001 1 ] The proposed filter is suitable for visual signals or acoustic signals, even ones with sudden variations. Various 
types of functions or signal features can be used to create the rules. With the method described, the signal features 
are correlated to the position of the sample in the considered sample window, to the difference between a given sample 
to and the sample at the center of the window, and to the difference between a given sample and the average of samples 
in the window. These signal features may have a considerable influence on the values of the weights for the recon- 
struction of the signal; in addition, they may be calculated in a relatively simple manner. 

[0012] The method and the filter according to the invention moreover comprise a neuro-fuzzy filter bank. In this way, 
the signal may be split into different sub-bands according to wavelet theory: each sub-band signal may be filtered by 

45 a neuro-fuzzy network, and then the various sub-bands can be reconstructed by the synthesis filter bank. As is known 
from wavelet theory, in the first sub-band the signal features have a low frequency, whereas in the last sub-band the 
signal features have the maximum frequency. If non-white noise (colored noise) is to be removed, this is approximated 
by white noise in each individual sub-band. Given that a neuro-fuzzy network works well on white noise, this solution 
leads to a sensible reduction in noise. 

50 [0013] The network is trained by supplying some configurations of input and output signals (the configuration of the 
output signal that it is required to obtain as a result of the network evolution is called target configuration). The training 
algorithm is based upon one of the known learning methods, such as gradient descent, a genetic algorithm, the sim- 
ulated annealing method, random search, or any other method for function optimization. 

[0014] For an understanding of the present invention, preferred embodiments thereof are now described, purely to 
55 furnish non-limiting examples, with reference to the attached drawings, in which: 

Figure 1 is a block diagram showing the general architecture of the filter according to the invention; 
Figure 2 represents the topology of a block of Figure 1 for a neuro-fuzzy network; 
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Figures 3a and 3b show a flowchart of the operations performed by the filter of Figure 1 ; 

Figure 4 shows a block diagram of a filtering device using the filter of Figure 1 ; 

Figure 5 shows the transfer functions of digital filters belonging to the filtering device of Figure 4; 

Figure 6 shows the block diagram of some digital filters belonging to the filtering device of Figure 4; 

Figure 7 shows a block diagram of another filtering device using the filter of Figure 1 ; 

Figure 8 shows a flowchart of the operation of the filtering device of Figure 7; 

Figure 9 shows a block diagram for the hardware implementation of the filter of Figure 1 ; and 

Figures 10a, 10b, and 10c respectively show a voice signal free from noise, the same signal superimposed on 

white noise, and the same signal after filtering according to the invention. 



[0015] Figure 1 shows a filter 1 comprising a signal-feature computation unit 2, a neuro-fuzzy network 3, a recon- 
struction unit 4, and a training unit 5. 

[0016] The signal-feature computation unit 2 receives at the input a signal In including of a plurality of input samples 
e(i), stores, at each clock cycle, (2N+ 1) input samples e(/) (which represent a work window for filter 1) in an internal 
is buffer, computes the signal features X1 (/), X2(/), and X3{i) for each input sample e(i) on the basis of all the input samples 
belonging to the work window (as described in detail hereinafter), and supplies the signal features X1 (#), X2(/), and X3 
(/) thus calculated to the neuro-fuzzy network 3. 

[0017] The neuro-fuzzy network 3 processes the signal features XI (/), X2(/), and X3(/) and generates at the output 
a reconstruction weight oL3(i) for each input sample e{t). To this aim, starting from the signal features X1 (/), X2(/), and 
20 X3(i) and for each input sample e(/) t the neuro-fuzzy network 3 first performs a fuzzification operation, then applies 
preset fuzzy rules, and finally carries out a defuzzification operation. The reconstruction weight o/_3(/) thus obtained is 
hence the weighted sum of all the input samples e(i) in the same work window, as explained in detail hereinafter with 
reference to Figures 2 and 3. 

[0018] The reconstruction unit 4 receives the reconstruction weights oL3(/) and the input samples e(i) and, after 
25 accumulating a sufficient number of input samples e(/) and of corresponding reconstruction weights oL3{I), generates 
an output sample u(i) the sequence of which forms an output signal Out. 

[0019] The training unit 5 is operative only initially, so as to train the neuro-fuzzy network 3 and modify the weights 
of the network with the aim of obtaining an optimal behavior of the filter 1 , as described in detail hereinafter. 
[0020] The signal features X1 (/), X2(/), and X3(/), computed in the signal-feature computation unit 2, are correlated, 
30 respectively, to the distance between each sample and the central sample of the considered window, to the difference 
between a given sample and the sample at the center of the window, and to the difference between a given sample 
and the average of samples in the window, and are normalized so as to obtain values between 0 and 1 . 
[0021] In detail, given a window of (2A/+ 1) input samples e(/), with / = 0, 2/V, the signal features X1(/), X2(/), and 
X3(/) for each input sample e{i) are defined as 

35 

XKO^ (D 

40 max(diff) w 

X3(/> M'>f , (3) 
v ' max{dtff_av) * ' 

45 where N is the position of a central sample e(N) in the work window; 

max (diff) = max (e(K)-e(A/)) with k=0, .... 2A/, i.e., the maximum of the differences between all the input samples e (k) 

and the central sample e(N)\ 

av is the average value of the input samples e(/); and 

max (diff_av) = max (e(K)-av) with k = 0, 2N, i.e., the maximum of the differences between all the input samples e 

50 (*) and the average value av. 

[0022] The neuro-fuzzy network 3 is a three-layer fuzzy network the functional representation of which appears in 
Figure 2, in which, for reasons of simplicity, the index # in parenthesis for the specific sample within the respective work 
window is not indicated. Nevertheless, as mentioned above, and as will emerge more clearly from the flowchart of 
Figures 3a, 3b, the neuro-fuzzy processing represented by Figure 2 is repeated for each input sample e(l). 

55 [0023] In detail, starting from the three signal features X1 , X2 and X3 (or generically from 1 signal features X1) and 
given k membership functions of a gaussian type for each signal feature (described by the average value W m (l, kj and 
by the variance WJtf, k), a fuzzification operation is performed in which the membership level of the signal features XI , 
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30 



40 



45 



X2 and X3 is evaluated with respect to each membership function (here two for each signal feature, so that k = 2; in 
all there are M= 1 x k = 6 membership functions). 

[0024] In Figure 2, the above operation is represented by six first-layer neurons 6, ach of which, starting from the 
three signal features XI , X2 and X3 (genericaliy designated by X/) and using as weights the average value W m (l, k) 
and the variance WJ(I, k) of the membership f unctions, supplies a first-layer output oL\(l t kj (hereinafter also designated 
by oL1 (m)) calculated as follows: 



10 oL\(I,k) = oL\(m) - exp 



( (Xl-WJl.k)) 



V 



(4) 



Hereinafter, a fuzzy AND operation is performed, using the norm of the minimum, in such a way as to obtain N second- 
's layer outputs ol2 (n). For example, N is equal to 6. As is known, a fuzzy AND operation using the norm of the minimum 
is based upon rules of the type: 

if X^) is V> and *2 (,) is and *3 (,) is >*3 (l) tnen ° is 
20 if x A W is AyW and X 2 ( n > is A 2 <") and X 3 <") is Aj(") then O is B^") 

in which A^) t A 2 ®, Bfl„ etc. are linguistic terms, such as "high" and "low", and the value of the output O for each 
rule is given by the minimum of the membership levels multiplied by a weight. 

[0025] In practice, with the neuro-fuzzy network of Figure 2, each second-layer output oL2(n) is equal to the minimum 
25 one among the products of the M outputs oL\ (m) of the first-layer neurons 6 and a respective second-layer weight 
W FA (m, n). 

[0026] In Figure 2 the above operation is represented by N second-layer neurons 7 which implement the equation 



oL2(n) = min {W FA (m, n) ■ oll(m)} ( 5 ) 



[0027] Finally, the third layer corresponds to a defuzzification operation and supplies at output a discrete-type re- 
35 construction weight oL3, using A/third-layer weights W DF (n). The defuzzification method is that of the center of gravity 
(centroid) and is represented in Figure 2 by a third-layer neuron 8 supplying the reconstruction weight oL3 according 
to the equation 



2> OF («)oI2(/i) 

oL3 = n -^— N (6) 

£oL2( M ) 



[0028] The reconstruction unit 4 then awaits a sufficient number of samples e(i) and corresponding reconstruction 
weights oL3(/) (at least 2N+ 1 , corresponding to the width of a work window) and calculates an output sample u(/) as 
the weighted sum of the input samples e(i - j), with / = 0 ... 2N, using the reconstruction weights oL3 (i - j), according 
50 to the equation 



Y d oL2{i-j)e(i-j) 
"O^-l* (7) 
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[0029] The training unit 5 operates only in an initial learning stage, when an input signal In having a known config- 
uration is supplied to the filter 1 , the output signal Out obtained is compared with a target signal Tg, and the distance 
between the obtained signal Out and the target signal Tg is evaluated on the basis of a fitness function. This fitness 
function may be, for example, the quadratic signal/noise ratio having the following expression: 

SNR-± (T8(0 \ 2 (8) 



10 in which 7" is the total number of input samples e{/). 

[0030] Using the fitness function and applying a method for function optimization, such as the gradient-descent meth- 
od, a genetic algorithm, the simulated-annealing method, and random search, the first-layer weights (mean value W m 
(/, k) and variance H^/, k) of the gaussian membership functions) and the third-layer weights W DF {n) are modified, 
and a new fitness evaluation is performed. The second-layer weights W FA (m, n) are instead randomly initialized and 

ts are not modified. The learning process is iterated until a preset value of the fitness function is achieved or until a preset 
number of genetic algorithms have been generated or a preset number of steps of the selected optimization algorithm 
has been performed. 

[0031] In this way, the neuro-fuzzy network 3 implements an adaptive algorithm and overcomes the limitations of 
neural networks or of fuzzy systems considered separately. In fact, fuzzy systems do not have learning capabilities 
20 and, if the selection of the fuzzy rules is not accurate, the fuzzy algorithm does not behave satisfactorily. Instead, using 
the neuro-fuzzy network 3 and carrying out a prior learning step it is possible to approach a signal having a complex 
mathematical structure, for example the voice in a noisy environment, without any prior knowledge of the mathematical 
laws governing the said system. 

[0032] Operation of the filter 1 of Figure 1 is described in detail hereinafter with reference to Figures 3a and 3b. 

25 [0033] Initially, the filter 1 is initialized, step 10, as is a window counter p, step 11 . Then the window counter p is 
incremented by (2N + 1), equal to the number of input samples e(Q in a work window, step 12, and the input samples 
of a work window ranging between e(p) and e(p + 2N) are loaded, step 13. A sum-of-samples counter h is initialized 
at 0, and a sum-of-samples variable S(0) is initialized with the value of the input sample e(p), step 14. Next, the sum- 
of-samples counter h is incremented by one unit, step 15, and the sum-of-samples variable S{h) is incremented with 

30 the value of a sample e(p + h), step 20. After the sum of (2N + 1) input samples (output YES from step 21), the sum- 
of-samples variable S(h) is equal to the sum of all the input samples e(i) and may be directly used for calculating the 
signal features. 

[0034] Subsequently, using equations (1), (2) and (3) and the value of the sum-of-samples variable S(h), the signal 
features X1 , X2, X3 are calculated for each sample e(p) -e(p + 2N) belonging to the considered work window, step 

35 22. A sample counter / for the input samples within the considered work window is then reset to zero, step 23, and 
subsequently incremented by one unit, step 24; a feature counter I for the number of signal features used (in the present 
case, 3) is reset to zero, step 25, and subsequently incremented, step 26; and a function counter frfor the number of 
membership functions used for each signal feature (in the present case, 2) is reset to zero, step 30, and subsequently 
incremented, step 31 . Next, the first-layer weights (the mean value W m (l, k) and the variance WJJ, k)) are loaded, step 

40 32, and the first-layer outputs oL\ (/, /c) are calculated in accordance with equation (4), step 33. 

[0035] Loading of the first-layer weights W m {l, k), WJ(I, A) and calculation of the first-layer outputs oL\ (/, k) are 
repeated for all the membership functions (output YES from step 34) and for all the signal features (output YES from 
step 35). 

[0036] Next, a second-layer neuron counter n is reset to zero, step 39, and incremented by one unit, step 40; an 
45 algorithm counter m is reset to zero, step 41 , and incremented, step 42; and the second-layer weights W FA (m, n) for 
the n-th second-layer neuron 7 are loaded, steps 43, 44. Then, the second-layer output oL2(n) for the n-th second- 
layer neuron 7 is calculated using equation (5), step 45, and the procedure of steps 40-45 is repeated for all the n 
second-layer neurons 7. 

[0037] At the end (output YES from step 50), the second-layer neuron counter n is reset again, step 51 , and incre- 
so mented by one unit, step 52; all the third-layer weights W DF [n) are loaded in succession, steps 53, 54; at the end of 

loading (output YES from step 54) the reconstruction weight oL3(i) is calculated in accordance with equation (6), step 55. 

[0038] The reconstruction weights oL3{!) thus calculated and the respective input samples e(/) are stored, step 60, 

and the procedure described for steps 24-60 is repeated for successive input samples e(i) until (2N+ 1 ) input samples 

e(/) are reached (output YES from step 61). 
55 [0039] Next, a sum counter / is reset to zero, step 62, and the input sample e(/) is added to the previous 2N input 

samples e(/ - j), and the sum is stored in a variable E, step 63. 

[0040] Afterthe sum of (2/V+ 1 ) input samples has been carried out, an output sample t/(/) is calculated in accordance 
with equation 7, step 65. 
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[0041] The entire cycle described by steps 12-65 is repeated as long as input samples e(i) are present; at the end 
(output YES from step 70), the sample processing procedure terminates. 

[0042] According to another aspect of the invention, filtering is based on a multi-resolution analysis obtained through 
a filter bank in phase quadrature. Wavelet theory furnishes the theoretical basis for multi-resolution. 

5 [0043] As is known, a multi-resolution analysis defines a set of nested subspaces of a square summable function 
space, i.e., the space of the finite-energy functions, widely known in physics and electrical engineering. On the basis 
of the above analysis, a projection of a function in one of these subspaces isolates the "roughest" details of the function, 
whilst projection of the function in the orthonormal complement of this subspace isolates the "finer" details of the func- 
tion. The procedure may be iterated to obtain a pyramid. From wavelet theory it is known that the operation may be 

10 performed using a bank of FIR filters, In which each FIR filter is followed by a subsampler). The signal thus split into 
sub-bands can be reconstructed using a bank of complementary filters, each of which is provided with a sample incre- 
menter(upsampler). 

[0044] A first embodiment of the above-mentioned solution is shown in Figure 4 and regards a multi-resolution filter 
80 generating two subspaces and using a first pair of Finite Impulse Response Quadrature Mirror Filters (FIR QMFs) 
is for the analysis and a second pair of FIR QMFs for the synthesis. 

[0045] In detail, the multi-resolution filter 80 receives, on an input 81 , an input signal s/r). The input signal s/0 is 
supplied to two input FIR filters H 0 , H, which perform a convolution operation so to output a corresponding filtered 
signal^ A equal to: 

y«<o=s*k< r >- / ('- r > (9) 



25 M 

in which M is the order of the filters H 0 , H A \ % it) , e, tt) is the Mh sample of the respective output sequence; s,{*) is 
30 the Mh sample of the input sequence; h^r), h^i) is the Mh tap of the input FIR filter H 0 , H 1 , in which 

M0 = (-1) r1 h o (2/-r+1) 

35 where / is an integer. 

[0046] The input FIR filters H 0 , have transfer functions shown in Figure 5 and thus define, respectively, a low- 
pass filter and a high-pass filter, and have the structure shown in Figure 6, where the generic tap h(t) corresponds to 
/Jo(r) or to fy(r), according to whether it is the input FIR filter H Q or the input FIR filter H v 

[0047] The outputs of the input FIR filters Hq, H a are each connected to a respective subsampling unit 84, 85 which 
40 discards the odd samples from the input signaK (*) , % <d and retains only the even samples, generating a respective 
signal e 0 (f), ei(Q. The outputs of the subsampling units 84, 85 are each connected to a respective neuro-fuzzy filter 
86, 87. Both of the neuro-fuzzy filters 86, 87 have the structure shown in Figure 1 . 

[0048] The output signals u 0 (f), ^(f) of the neuro-fuzzy filters 86, 87 are each supplied to a respective upsampler 
88, 89 which generates a respective output signal u 0o (f) , u (f) by entering a zero sample between each pair of samples 
45 of the respective output signal t/ 0 (Q, ^(f) of the neuro-fuzzy filters 86, 87. The outputs of the of the upsampling units 
88, 89 are each connected to a respective output FIR filter G 0 , G v These filters too have each a respective transfer 
function given by equation (9) and equation (10), respectively. 

[0049] Finally, the output signals of the output FIR filters G Q , are added together, sample by sample, by an adder 
92. 

so [0050] Figure 7 shows a multi-resolution filter 95 using eight subspaces. In detail, the input signal s,{f) is initially 
supplied to two first synthesis FIR filters H 001 , H 102 , respectively of the low-pass type and of the high-pass type, and 
is then subsampled in two first subsampling units 96, 97, in a similar way as described for the units 85, 86 of Figure 
4. The sequences of samples thus obtained are each supplied to two synthesis filters (and hence altogether to four 
second synthesis FIR filters H 011 , H 112 , /^ 13> and H 114 ). The outputs of the second synthesis FIR filters H 011 , tf 112 , 

55 ^013* anc l are tnen supplied to four second subsampling units 100-103, and each sequence thus obtained is 
supplied to two third synthesis FIR filters (and hence altogether to eight third synthesis FIR filters H 021 , H 122 , H^, 
H 124 , Hq2 5 , H 126 , Ho??, H 128 ), generating eight sequences of samples. The eight sample sequences are then supplied 
to eight third subsampling units 107-1 14 and processed in respective neuro-fuzzy filters 120-127 having the structure 
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illustrated In Figure 1 . The sample sequences present on the outputs of the neuro-fuzzy filters 1 20-1 27 are then incre- 
mented via upsampling units 130-137 and supplied to respective first synthesis FIR filters G^, G 122> G 023 , G 124» G 025» 
G 126 , GQ27, and G 128 . The sample sequences thus obtained are added up two by two through four adders 140-143 
(with a reverse process with respect to the one followed downstream of the second subsampting units 100-103), sup- 
s plied to four upsampling units 146-149, and filtered again through four second synthesis FIR filters G 011 , G 112 , G 013 , 
and G 114 . 

[0051] The sample sequences thus obtained are added up two by two through two adders 150, 151 (according to a 
reverse process with respect to the one followed downstream of the first subsampling units 96, 97), incremented by 
two upsampling units 154, 155, filtered through two third synthesis FIR filters G 001 and G 102 , and finally summed in an 
10 adder 1 60 so as to supply the output signal s 0 (f). 

[0052] Figure 8 shows a flowchart of the sequence of steps performed using a multi-resolution filter with a preset 
arbitrary number of splittings into subspaces. 

[0053] Initially, the samples of the input signal s,{r) are loaded, step 160; then a space split counter /is initialized at 
-1 , step 161, and incremented by one unit, step 162; a subspace counter k is initialized at zero, step 163, and incre- 

15 mented by one unit, step 164. Then the samples of the input signal s/f) are filtered using the filter H 0 j k (thus, at the 
first iteration, using the filter H^), step 165, and the filtered samples are downsampled, step 166. Next, the subspace 
counter k is incremented, step 170; the samples of the input signal s^O are filtered using the filter (thus, at the first 
iteration, using the filter H 102 ), step 171 , and the filtered samples are downsampled, step 172. 
[0054] It is checked whether the subspace counter k is equal to 2^ 1 ); if it is not, the cycle comprising steps 1 64-1 72 

20 is repeated (in the iterations following on the first, filtering is performed on the samples obtained in the previous iteration 
with the filter Hb(H)(*-2) or w i(/-i)(fr-2)) ; if it is (output YES from step 1 73) , it is checked whether the splitting into sub- 
spaces is terminated (i.e., whether the space split counter j has reached the preset maximum), step 1 74. If it has not, 
the procedure returns to step 1 62; if it has, all the obtained sample sequences are filtered using the neuro-fuzzy filter 
of Figure 1, step 175. 

25 [0055] Next, the space split counter / is initialized at its maximum value plus one unit, step 1 80, and then decreased 
by one unit, step 1 81 , the subspace counter k is initialized at zero, step 1 82, and incremented by one unit, step 1 83. 
Next, the first sample sequence at output of the first neuro-fuzzy filter (120, in Figure 7) is upsampled, step 184, and 
filtered using a filter G 0 j k (thus, at the first iteration, using the filter G 021 ), step 185. Then, the subspace counter k is 
incremented again, step 190; a second sample sequence at the output of a second neuro-fuzzy filter (121 , in Figure 

30 7) is upsampled, step 1 91 , and filtered using a filter Gy k (thus, at the first iteration, using the filter G 121 ), step 1 92. The 
samples at the output of the filters Gq k and Gy k are then summed, step 1 93. 

[0056] It is then checked whether the subspace counter k is equal to step 1 94; if it is not, the cycle comprising 
steps 1 83-1 93 is repeated (processing the sample sequences at the output of the subsequent neuro-fuzzy filters); if it 
is (output YES from step 194), it is checked whether the end has been reached, step 195; if it has not, the procedure 
35 returns to step 1 81 , decreasing the space split counter /and processing the sample sequences previously upsampled, 
filtered and summed. The loop defined by steps 181-1 94 is repeated until a single sequence of samples is obtained, 
corresponding to the output signal S c (f), output YES from step 195. 

[0057] Figure 9 shows the hardware implementation of the neuro-fuzzy filter 1 of Figure 1 . In detail, the neuro-fuzzy 
filter 1 comprises a data memory 200, three work memories 201-203, a signal features calculation module 205, a 
40 control unit 206, a first -layer output memory unit 207, a second-layer output calculating unit 208, a reconstruction- 
weight calculating unit 209, and a reconstruction unit 210. 

[0058] The data memory 200 stores the (2A/+ 1 ) samples e(/) of each work window and comprises (2A/+ 1 ) registers, 
each having 16 bits. 

[0059] The work memories 201-203 are nonvolatile memories, for example ROM, PROM, EPROM, EEPROM or 
^5 flash memories. 

[0060] In particular, the first work memory 201 stores the first signal feature X1 (/) and comprises {2N+ 1) sixteen- 
bit memory locations. Since the value of the first signal feature X1 (/) for the Mh sample is constant in the various sample 
windows, as is evident from equation (1), the contents of the first work memory 201 must not be modified during the 
learning step or during operation of the neuro-fuzzy filter 1 , and the first work memory 201 may be implemented using 

50 any one of the technologies referred to above. 

[0061] The second work memory 202 stores the values of the two gaussian curves described by equation (2) ac- 
cording to the values of the signal features X1 , X2 t and X3. Since the values of these gaussian curves depend upon 
the second-layer weights W^l, k), W v (l, k), when a learning step is provided, the second work memory 202 must be 
of the programmable type, for example of the EPROM, EEPROM or flash type. To avoid the use of a memory of 

55 excessive size, the gaussian functions (which represent the membership functions of the signal features X1 , X2, X3, 
as discussed above) are stored as discrete values, according to the desired level of accuracy. For example, if the 
membership functions have 256 values, with an accuracy of 16 bits per value, considering two sets of fuzzy rules for 
each signal feature X1 , X2, and X3, the second work memory 202 must have a storage capacity of 256 x 16 x 6 bits. 
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The second work memory 202 is then addressed starting from the current values (corresponding to the Ath sample) 
of the signal features X'\,X2,X3 supplied by the first work memory 201 and by the signal features calculation module 
205, and outputs (to the first-layer output memory unit 207) the values of the six first-layer outputs oL1 (m). 
[0062] The third work memory 203 stores the second-layer weights W FA (m, n) and the third-layer weights W DF {n). 

5 Since the third-layer weights W DF (n) are generally modified during the learning step, the third work memory 203 is of 
a programmable type, as is the second work memory 202. In detail, if there are Afx N second-layer weights W FA (m f 
n) and N third-layer weights W DF (n), the work memory 203 comprises (16xMxN+16x/V) bits. 
[0063] The signal features calculation module 205 comprises a hardware network (not shown) represented as divided 
into a first part 205a for calculating the second signal feature X2 (/) and a second part 205b for calculating the third 

10 signal feature A2 (/). In the signal features calculation module 205 the operations represented by equations (2) and 
(3) are performed, and this module comprises a sample memory (having 2A/+ 1 locations), a unit for calculating the 
average value av, a unit for calculating the maximum of the differences between all the input samples and the central 
sample max (diff), a unit for calculating the maximum of the differences between all the input samples and the average 
value max (diff^arf, and a unit for calculating the fractions defined by equations (2) and (3). 

15 [0064] The first-layer output memory unit 207 comprises six registers 21 2 which store the first-layer outputs o/_1 (m) 
supplied by the second work memory 202. 

[0065] The second-layer output calculating unit 208 comprises two modules, namely, a first multiplication module 
208a and a minimum module 208b. In detail, the first multiplication module 208a includes six first multiplication units 
21 3 each of which multiplies a respective first-layer output oL1 (m) (supplied by the first-layer output memory unit 207) 

20 by n respective second-layer weights W FA (m, n) (supplied by the second work memory 203); the second multiplication 
module 208b includes six minimum units 214 which, starting from the six respective products oL\(m) x W FA (m, n), 
calculate the minimum thereof, supplying at the output a respective second-layer output oL2(n). 
[0066] The reconstruction-weight calculating unit 209 comprises two modules, namely, a second multiplication mod- 
ule 209a and a defuzzification module 209b. In detail, the second multiplication module 209a includes six second 

25 multiplication units 215 which multiply a respective second-layer output oL2{n), supplied by the second-layer output 
calculating unit 208, by a respective third-layer weight W DF (n) y supplied by the third work memory 203. The defuzzifi- 
cation module 209b calculates the reconstruction weights oL3, adding the products supplied by the second multiplica- 
tion module 209a, adding together the second-layer outputs oL2{n), and calculating the ratio between the two sums 
in accordance with equation (6). 

30 [0067] The reconstruction unit 21 0 stores the reconstruction weights oL3(t) as these are supplied by the reconstruc- 
tion-weight calculating unit 209 and, as soon as it has stored 2N+ 1 reconstruction weights oL3, it calculates the output 
sample i/(2A/+ 1) in accordance with equation (7), also using the values of the 2N + 1 samples supplied by the data 
memory 200. Subsequently, upon receipt of the next reconstruction weight oL3(2N+ 2), it calculates the output sample 
0{2N + 2) using also the previous 2N reconstruction weights oL3 and as many samples coming from the data memory 

35 200, in accordance with equation (7). 

[0068] The control unit 206 determines the processing sequence and data loading/transfer between the various units 
and modules. To calculate a single output sample, the control unit repeats the sequence of steps of the fuzzy algorithm 
2A/+ 1 times, updates the data memory 200 at the end of 2N+ 1 cycles, and controls loading of successive 2N+ 1 
samples. 

40 [0069] The advantages of the method and filter illustrated herein are described below. First, the method and filter 
reduce the noise of the input signal, whether the noise in question is of a white type or of a colored type, and enable 
separation of signals having different features. The filter preserves the steep edges of the signals without causing any 
losses of signal features, as is evident from a comparison between Figures 10a, 10b, and 10c. In particular, Figure 
10a is a plot of a non-noisy voice signal (namely, a signal fragment corresponding to the vowel "e", with sampling at 

45 44.1 kHz and a 16-bit A-D conversion resolution); Figure 10b is a plot the same signal as in Figure 10a, in presence 
of white noise; and Figure 1 0c shows the result of filtration of the signal of Figure 1 0b using the filter device 95 of Figure 7. 
[0070] Since the filter can be trained, it can be adapted to a specific type of initial signal and can be subsequently 
modified if so required. For example, the filter can be initially adapted to a first type of acoustic signal (for instance, a 
male voice with white noise, training being performed with two signals, one in the presence of white noise and one in 

so the absence of noise). Then, the learning step can be repeated for signals of a different type, for example a female 
voice. The new weights thus calculated can replace the previous ones or be stored in addition to the previous ones; 
in the latter case, the control unit 206 controlling the filter 1 can control sending, to the units 207-209 (Figure 9), either 
of the first or of the second samples according to the use of the filter. 

[0071] Finally, it is clear that numerous variations and modifications may be made to the method and filter described 
55 and illustrated herein, all falling within the scope of the invention, as defined in the annexed claims. 
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Claims 

1 . A filtering device (80; 95) for filtering signals having steep edges, haract rized by at least one neuro-fuzzy filter 
d). 

5 

2. A filtering device according to Claim 1 , characterized in that said neuro-fuzzy filter (1 ) comprises: 

a signal-feature calculating unit (2) receiving input samples (e(i)) of a signal (In) to be filtered and generating 
signal features (X1(/), X2(/), X3(i)) ; 
10 a neuro-fuzzy network (3) receiving said signal features and generating reconstruction weights (ol3(/)); and 

a moving-average reconstruction unit (4) receiving said input samples (e(/)) and said reconstruction weights 
(013(0), and generating output samples (u(i)) from said input samples and said reconstruction weights. 

3. A filtering device according to Claim 2, characterized in that said signal-feature calculating unit (2) comprises a 
is memory (200) storing a first plurality of input samples (©(/)) forming a first window, and a feature-calculating network 

(201 , 205) receiving said first plurality of input samples and supplying a plurality of features (X1 (/), X2(/), X3(/)) for 
each one of said input samples. 

4. A device according to Claim 3, characterized In that said feature-calculating network (201 , 205) comprises first 
20 feature-providing means (201) which generate, for each of said input samples (e(/)), a first signal feature (X1(/)) 

correlated to a position of said input sample in said first window; second feature-providing means (205a) which 
generate, for each of said input samples (etf)), a second signal feature (X2(/)) correlated to the difference between 
said input sample and a central sample (e(N)) in said first window; and third feature-providing means (205b) which 
generate, for each of said input samples (e(/)), a third signal feature (X3(/)) correlated to the difference between 
25 said input sample and an average sample value in said first window. 

5. A device according to Claim 4, characterized In that said first feature-providing means (201 ) generate said first 
signal feature (XI (/)) for an input sample (e(/)) according to the relation 

30 IJLAJ 

X1(/)=!^ 

wherein / is the position of said input sample (e(t)) in said first window, and N is the position of a central sample in 
said first window. 

35 

6. A device according to Claim 5, characterized in that said first feature-providing means comprise a first work 
memory (201) storing said first signal feature (X1 (/)) for each one of said input samples (e(/)). 

7. A device according to any of Claims 4-6, characterized in that said second feature-providing means (205a) gen- 
40 erate said second signal feature (X2(/)) for an input sample (e(0) according to the relation 

45 wherein e(N) is a central sample in said first window, and max (o7/r) is the maximum of the differences between 

all the input samples in said first window and said central sample. 

8. A device according to any of Claims 4-7, characterized in that said third feature-providing means (205b) generate 
said third signal feature (X3(/)) for an input sample (e(j)) according to the relation 

so 

X3 (/)=-!f^L . 

v ' max(cWLav) 

wherein av is the average value of the input samples in said first window, and max (diff_av) is the maximum of the 
55 differences between all the input samples in said first window and said average value av. 

9. A device according to any of Claims 2-8, characterized In that said neuro-fuzzy network (3) comprises: 
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fuzzffication neurons (6, 202) receiving said signal features (X1(/), X2(/), X3(t)) of an input sample (e(/)) and 
generating first-layer outputs (of_1) defining a confidence level of said signal features with respect to preset 
membership functions; 

fuzzy neurons (7) of an AND type, receiving said first-layer outputs and generating second-layer outputs (oL2) 
5 deriving from fuzzy rules; and 

a defuzziflcation neuron (8) receiving said second-layer outputs and generating a reconstruction weight (oL3) 
for each of said input samples (e(/)), using a center-of-gravity criterion. 

10. A device according to Claim 9, characterized In that said membership functions are gaussian functions, and said 
10 first-layer outputs are calculated according to the equation 



15 



35 



40 



45 



50 



011(1, £)=exp 



wherein oil (/, A) is a first-layer output, X1 is a signal feature, W m (l, fc) is the mean value, and WJJ, *) is the variance 
of a gaussian function. 

20 11. A filtering device according to Claim 9 or 10, characterized in that it comprises two membership functions for 
each one of said signal features (X1(/), XZ(i), X3(/)). 

12. A filtering device according to any of Claims 9-11 , characterized in that said first-layer neurons (6) comprise a 
second work memory (202) storing values of said first-layer outputs (oZ.1 (/, K)) for each value of said signal features 

25 (X1(/), X2(i), X3(/)). 

13. A filtering device according to any of Claims 9-12, characterized In that said fuzzy rules are of an AND type, and 
said second-layer outputs (oL2) use the norm of the minimum. 

30 14. A filtering device according to Claim 13, characterized in that said second-layer outputs are calculated according 
to the equation 

oL2(n) - min §V FA (m, ri) • oL\(m) } 

wherein oL2(n) is a second-layer output; W FA (m t n) is a second-layer weight, and oU (I, A) is a first-layer output. 

15. A filtering device according to Claim 14, characterized In that said second-layer neurons (7) comprise a plurality 
of multiplication units (213) and a plurality of minimum modules (214) cascade -connected together. 

16. A filtering device according to any of Claims 9-15, characterized in that said reconstruction weights are calculated 
according to the equation 



£w DF (n).oL2(n) 



±oL2(n) 

wherein oL3(n) is a reconstruction weight; W Df {n) are third-layer weights, and oL2(n) is a second-layer output. 

17. A filtering device according to any of Claims 9-1 6, characterized in that said moving-average reconstruction unit 
(4) receives a second plurality of input samples (e(/)) forming a second window, and a corresponding plurality of 
55 reconstruction weights (oL3{i)), and calculates each of said output samples according to the equation 
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10 



15 



ZcLXi-A-eQ-j) 

"(O^ w 

wherein e(i-j) is an (Ay) -th input sample, and oL3{i-j) is a reconstruction weight associated to an (hj) -th input sample. 

18. A filtering device according to any of Claims 9-17, characterized by a training unit (5) having a first input connected 
to said moving-average reconstruction unit (4) and receiving said output samples ((/(/)), a second input receiving 
a desired output signal (Tg), and an output connected to said neuro-fuzzy network (3) to supply optimized weighting 
values. 



19. A filtering device according to any of Claims 1-18, characterized by a first splitting stage (H 1( H 0 , 84, 85; H 001 , 
Mj 02, 96, 97) generating at least two streams of samples to be filtered; one said neuro-fuzzy filter (86, 87; 1 20-1 27) 
for each stream of samples to be filtered, each of said neuro-fuzzy filters generating a respective stream of filtered 
samples; and a first recomposition stage (88, 89, 92, G 0 , G 1 ; 154, 155, 160, G 001 , G 102 ) receiving said streams 

20 of filtered samples and generating a single stream of output samples (s 0 ). 

20. A filtering device according to Claim 1 9, characterized by a plurality of further splitting stages (H 011 -H 128 , 1 00-11 4) 
cascade-connected together and to said first splitting stage (H^, H 102 , 96, 97), and a plurality of further recom- 
position stages (1 30-1 51 , G 021 -G 114 ) cascade-connected to each other between said neuro-fuzzy filters (1 20-1 27) 

25 and said first recomposition stage (154, 155, 160, G^, G 102 ). 

21. A filtering device according to Claim 19 or 20, characterized In that said splitting stages (H A , H 0 , 84, 85; H 001 - 
H 128 , 96-114) each comprise a first and a second analysis filters (H^ H 0 , H^-H^g) in phase quadrature to each 
other and receiving a stream of samples to be split, said first and a second analysis filters generating a respected 

30 stream of split samples, and a first and a second downsampling unit (84, 85; 96-114), each of which receives a 

respective stream of split samples, 

and in that said recomposition stages (88,89,92, G 0 , G^ 130-160, G 021 *G 102 ) each comprise a first and a second 
upsampling units (88, 89; 130-137, 146-149, 154, 155), each first and a second upsampling units receiving a 
respective stream of samples to be incremented and generating a respective stream of incremented samples; a 
35 first and a second synthesis filters (G 0 , G^ Gq 21 -G 102 ) in quadrature with to each other and complementary to 

said analysis filters, each of said first and a second synthesis filters receiving a respective stream of incremented 
samples and generating a respective stream of partial samples; and an adder node (92; 140-143, 150, 151 , 160) 
receiving said streams of partial samples and generating a stream of added samples. 

40 22. A filtering device according to Claim 21 , characterized in that said analysis filters (H v H 0 , H 001 -H 128 ) are quad- 
rature mirror filters (QM Fs), and said synthesis filters (G 0 , G 1 ; G^ -G 102 ) are QMFs complementary to said analysis 
filters. 



23. A filtering device according to Claim 22, characterized in that said quadrature mirror filters (H^ H 0 ; H 001 -H 128 ; 
45 G 0 , G^ G 021 -G 102 ) are convolutive filters. 

24. A method for reducing noise in a filter having sharp edges, characterized by a neuro-fuzzy filtering step. 

25. A method according to Claim 24, characterized in that it comprises the steps of: 

so 

calculating signal features (X1(/), X2(/), X3(/)) from input samples (e(/)) of a signal (In) to be filtered; 
calculating reconstruction weights (oL3) from said signal features using a neuro-fuzzy network (3); and 
reconstructing, from said input samples and said reconstruction weights and using a moving-average filter, 
an output signal (Out) including a plurality of output samples (u(i)). 

55 

26. A method according to Claim 25, characterized by the steps of: 

storing a first plurality of input samples (e(t)) forming a first window; and 
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calculating, from said first plurality of input samples, a plurality of signal features (X1 (/), X2{i), X3(i)) for each 
of said input samples. 

27. A method according to Claim 26, charact rized in that said step of calculating a plurality of signal features for 
each of said input samples comprises the steps of: 

calculating a first signal feature (X1 (/)) correlated to a position of said input sample (e(i)) in said first window; 
calculating a second signal feature (A2(/)) correlated to the difference between said input sample and a central 
sample in said first window; and 

calculating a third signal feature (X3(i)) correlated to the difference between said input sample and an average 
sample value av in said first window. 

28. A method according to Claim 26 or 27, characterized in that said step of calculating reconstruction weights (oL3) 
comprises the steps of: 

performing a f uzzification operation and calculating first-layer outputs (oil ) defining confidence levels of said 
signal features (X1 (/), X2(/), X3{fj) with respect to preset membership functions; 

performing a fuzzy AND operation and generating second-layer outputs (oL2) deriving from fuzzy rules, starting 
from said first-layer outputs; and 

performing a def uzzification operation on said second-layer outputs and generating a reconstruction weight 
(oL3) for each one of said input samples (e(i)) f using a center-of -gravity criterion of the. 

29. A method according to Claim 28, characterized in that said membership functions are gaussian functions, and 
said first-layer outputs are calculated according to the equation 



wherein oL\ [I, rt) is a first-layer output, X1 is a signal feature, W m (l, *) is the mean value, and WJil, A) is the variance 
of a gaussian function. 

30. A method according to Claim 28 or 29, characterized in that said second-layer outputs are calculated according 
to the equation 



wherein oL2(n) is a second-layer output; W FA (m, n) is a second-layer weight, and oL\ (/, A) is a first-layer output. 

31. A method according to any of Claims 28-30, characterized in that said reconstruction weights are calculated 
according to the equation 



wherein oL3 is a reconstruction weight; W DF (n) are third-layer weights, and oL2(n) is a second-layer output. 

32. A method according to any of Claims 26-31 , characterized in that said step of reconstructing using a moving- 
average filter comprises the steps of: 

receiving a second plurality of input samples (e{i)) forming a second window, and a respective plurality of 
reconstruction weights (oL3(/)); and 




oL2(n) = min $V FA (m, n) • oL\{mj) 



^W DF (n)oL2{n) 



oL3 = 



n = \ 
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45 



50 



calculating each of said output samples according to the equation 

IN 

£oI3(/-;>e(/-,) 



«(/)= 



2>(/-;) 



* 0 wherein e(/-y) is an (/-» -th input sample, and oL3 (i-j) is a reconstruction weight associated to an (A/)-th input sample. 

33. A method according to any of Claims 24-32, characterized by a training step for training weights used in said 
neuro-fuzzy filtering step. 

15 34. A method according to Claim 33, characterized In that said training step comprises the steps of: 
generating an input signal having a known configuration; 

filtering said input signal having a known configuration to obtain a test output signal; 
comparing said test output signal with a desired signal (Tg) to obtain a distance between said test output signal 
20 and said desired signal; 

calculating a fitness function from said distance; and 
optimizing said weights in accordance with said fitness function. 

35. A method according to any of Claims 26-34, characterized by a multiresolution analysis whereby the signal is 
25 splitted into sub-bands through orthonormal wavelets. 

36. A method according to Claim 35, characterized by the steps of: 

splitting a stream of input samples into at least two streams of samples to be filtered; 
^o filtering each stream of samples to be filtered using a respective neuro-fuzzy filter (86, 87; 120-127) to obtain 

at least two streams of filtered samples; and 

recomposing said streams of filtered samples to generate a single stream of output samples (s Q ). 

37. A method according to Claim 36, characterized in that, before performing said step of filtering, said step of splitting 
35 is repeated a preset number of times, and in that, after performing said step of filtering, said step of recomposing 

is repeated said preset number of times. 

38. A method according to Claim 36 or 37, characterized in that said step of splitting comprises the steps of: 

40 feeding a stream of samples to be split to two analysis filters in phase quadrature to each other; 

generating two streams of filtered split samples; and 
downsampling said streams of filtered split samples, 



and in that said step of recomposing comprises the steps of: 

upsampling streams of samples to be incremented, generating streams of incremented samples; 
filtering said streams of incremented samples using two synthesis filters in phase quadrature to each other 
and complementary to said analysis filters, generating streams of partial samples; and 
adding pairs of streams of partial samples and generating a stream of added samples. 



55 
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